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ANOTHER ASYMPTOTIC NOTATION : "ALMOST" 

NABARUN MONDAL AND PARTHA P. GHOSH 

Abstract. Asymptotic notations are heavily used while analysing runtimes of 
algorithms. Present paper argues that some of these usages are non trivial, 
therefore incurring errors in communication of ideas. After careful reconsidera- 
tion of the various existing notations a new notation is proposed. This notation 
has similarities with the other heavily used notations like Big-Oh, Big Theta, 
while being more accurate when describing the order relationship. It has been 
f^ ' argued that this notation is more suitable for describing algorithm runtime than 

(N : Big-oh. 

Oh' 
< 

^ ■ 1. The Problem At Hand 

CN ; 

Describing the exact runtime of an algorithm [3][S][B] is not a trivial task. Hence, 

^ ! the effort is directed upon finding a function that approximates the runtime. To 

^ I describe the approximate runtime for the algorithms, the concept of asymptotic no- 

c/3 ■ tations were borrowed from Number Theory [I][2]P]. In this section we discuss the 

most common of the asymptotic notations, introduced by Bachmann-Landau [lj[2j, 

and describe the semantic problem with the overly used Big-Oh notation[3j[5j[6j|4j. 

^ ; Definition 1.1. Big-Oh : 0(.) 

Let f[n) and g{n) be functions such that :- 

^: 

in . 3A; > 3no Vn > no \f{n)\ < \g{n) ■ k\ 

Q I then f{n) E 0{g{n)) or with some abuse of notation f{n) = 0{g{n)). 



O 



m 



Informally this stands for / is bounded above by g (up to constant factor) 
asymptotically. 



/\t . Definition 1.2. Small- Oh : of.) 
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Let f{n) and g{n) be functions such that :- 

VA; > 3no \fn > tiq \f{n)\ < k ■ \g{n)\ 
then f{n) G o{g{n)) or with some abuse of notation f{n) = o{g{n)). 

Informally this stands for / is dominated by g (up to constant factor) asymp- 
totically. 

Theorem 1.1. Relation between Big-0 and Small-o. 

Iffeoig) thenfeOig). 

Proof. We compare the definitions (11.21) and (II. ip . Note that the / G o{g) =^ 3k 
for which |/(^)| < \g{i^) ' k\- Hence the given is proved. D 

This theorem (II. ip creates a confusion about the way mathematicians use the 
big-oh notation f = 0{g) and computer engineers use them. Let / G 0{g), then 
from Computer Engineering standpoint :- 

"growth rate of f is of the order of g" 

and it's precise mathematical meaning:- 

"growth rate of f is less than or equal to the order of g" 

We now demonstrate the confusion with a real example. For any algorithm A 
let the average runtime complexity be a function '^(ra)' and worst case runtime 
complexity be another function W(n)' where 'ra' be the input size. In the strictly 
mathematical way A G 0{W). However, this becomes counter intuitive as the 
intuitive notion of big-0 as the order of the expression as it is majorly used in 
Engineering. 

Example of Quick sort can be used to demonstrate the point. A(n) ^ nLog2n 
and W{n) ^ ri^. Strictly mathematically :- 

nLog2{n) = 0{n^) = 0{n^) = 0{n^) ; k > 2 

because 

nLog2{n) = o{n'^) = o{n^) = o{n^) ; k >2 

and / = o{g) =^ f = 0{g). However, clearly the order-of nLog2{n) is not the order 
of n? or n^ etc, and the confusion arises because technically 0{g) family is not an 
open family of functions (it depicts the relation '<' in some sense). The family of 
functions o{g) is however an open family, depicting the relation '<' [1][3]. Simply 
put Big-Oh is not the of the order of function family. 

2. Stricter Asymptotic Bounds 

This problem of confusion on notation with intuition can be avoided by using 
any stricter notion, which should match with the intuition of growth order. One 
such Bachmann-Landau notation is the Big-Theta notation which is described 
next. 
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Definition 2.1. Big-Theta : &(.) 

Let f{n) and g[n) he functions such that :- 

3ki > 3k2 > 3^0 Vn > uq 

gin) ■ ki < fin) < gin) ■ fcg 
then fin) G Qigin)) or with abuse of notation fin) = Qigin)). 

This stands for / is bounded botli above and below by g asymptotically. For 
example given that the function fin) = n^ + lOOOn^ + n + 300 then, / G o(n^) 
as well as / G O(n^). But / G 0(n^) so is / G 0(n^ + n^), so on and so forth. 
Therefore, the notation 0(.) allows one to be far more accurate than that of the 
more popular 0(.) notation, but still, not enough accurate. One simple example 
to show this would be fin) = 2 — sinin) while gin) = c a constant function with 
c > 0. Clearly / = 0((?) but, then, accuracy is lost here. 

One way to resolve this loss of accuracy is to find an equivalence or similar 
notation, the real on the order of notation as defined next. 

Definition 2.2. On the Order Of : ~ 

Let fin) and gin) he functions such that :- 

fin) 



Ve: > 3^0 Vn > nQ 



gin) 



< e 



then, f r^ g. 



The problem with definition 12.21 is that this is much of a strict bound. It might 
not be optimal to find a function g that approximates / till the exact same growth 
order. For example take the function /(n) = 3n^ + 2n^ + n. We have gin) = 3n^ 
which makes f ^ g but for another g'in) = n? f r^ g' . Constant factors should be 
ignored, in this case it is not. We note that, however, another way of representing 
the same notation is:- 

/ ^ ^ ^ Vn > no 44 ^ 1 

gin) 

Replacing the constant 1 with a varying parameter K makes it into a better as- 
ymptotic notation independent of the constant factor. But that factor, should 
never be or oo. 

Therefore, we can define a new, but similar asymptotic notation "Almost" . 

Definition 2.3. Almost : a(K,.). 

A function fin) is almost gin) or f E aiK,g) iff:- 

f(n) 
lim ^^ = K ; 0< K <oo 

n-i>oo g[n) 

exists. 
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3. Properties of "Almost" 

In this section we establish properties of "almost" with theorems which relates 
the notation of almost (definition 12.31) with other notations. 
The trivial properties first :- 

(1) f Ea{l,f) , that is/a/ . 

(2) / e a{K, g) ^ g E a{l/K, f) which is / a gf =^ g f a. 

(3) / G a{Ki,g) and g G a{K2, h) then / G aiK^, h) with K^ = K1K2 that is 
fag and g a h =^ f ah. 

(4) /Ga(l,^) ^ fr^g. 

Theorem 3.1. a(.,.) is Equivalence Class Relation. 

Functions related using the notation a(.,.) (definition \2J^) are an equivalence 
class of functions. 

Proof. The first three trivial properties demonstrates this. D 

Theorem 3.2. Relation of a(.) with 0(.). 
If f E a{K,g) then f E 0{g) but not vice versa. 



Proof. If we have 



limM = ir 
n^oo g[n) 



We note that / G a{k,g) implies < K, while / G 0{g) implies 3k ; < k. 
Which establishes the theorem. D 

Theorem 3.3. Relation of a{.) with 6(.). 

(l)IffEa{K,g) thenfEQ{g). 

(2) If f E Q{g) then it is not necessary to have f E a{K,g). 

(3) Therefore, relation a(.) is a subset ofQ{.). 

Proof. By definition we have for n > uq f{n) = Kg{n). That is, obviously / < 
{K + l)g and clearly / > {K — l)g. Which means, tallying with the definition 12. 11 
we have ki = K — 1 and k2 = K + 1. Which proves the first part. 

We show the second part by bringing in one example. Let f{n) = 2 — sin{n). 
Clearly then sup{f{n)) = 3 and inf(/(ra)) = 1. Obviously then we can define 
g{n) = 1, with ki = 1 with k2 = 3, so that :- 

hg < f < hg 

and therefore / G 0(1). However, no limit exists for the ratio f{n)/g{n) with 
n — 7- 00, and therefore / ^ a{k,g). 

These show that there are functions / = 0(5') but / 7^ a(, g), hence, the relation 
between the family is depicted as a C O. D 
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4. Summary : Advantage of using "almost" 

There is no way one can state / G a{K,g), unless, they are comparable to the 
limit, as defined by definition 12.31 

Therefore, the biggest advantage of the proposed notation is less confusion in 
the usage of the notation, because almost is an equivalence notation. Take for 
example n'^ G 0{n^) but n^ ^ 0{v?). But clearly n"^ ^ a^K^n?). 

In the same note, one can not in general write A = a{K, W) like in section [1] , 
unless, of course A, W are really comparable, as in merge-sort. In specificity, we 
can not use the notation a{K, .) to compare / = nLog2{n) and g = n^, in case of 
Quick Sort. 

Given the limit at infinity exists, almost becomes both the tight upper and lower 
bound, that is G(.) from definition 12. II using the theorem 13.31 On the other hand, 
if no such limit exists (example given is theorem 13.31) , we can still use the original 
0(.) notation. 

In summary, the notation a{K, .) has advantages borrowed from all the nota- 
tions, without any of their shortcomings, as long as it can be defined. Also, this 
is not as much a tight bound compare to the notation ~ (definition 12.21) . 
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